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ABSTRACT 

The  rapid  diagnosis  of  invisible  internal  injury  in  an  austere  and  hostile  front-line  operational  environment 
remains  a  challenge  for  (Canadian  Forces )  medical  and  search  and  rescue  personnel.  The  availability  of  a 
portable  4D-ultrasound  imaging  system  with  a  single  probe,  providing  high  image  resolution  and  deep 
penetration,  is  considered  by  (civilian)  medical  practitioners  and  their  military  health  services  counterparts 
as  exceedingly  helpful,  if  not  essential  in  supporting  triage  and  medical  decisions  to  save  lives.  However, 
portable  and  easy-to-use  4D  non-invasive  medical  imaging  systems  are  not  yet  commercially  available, 
primarily  because  of  unresolved  major  technological  arid  engineering  challenges.  Available  portable 
ultrasound  systems  only  provide  2D  images,  requiring  a  medical  professional  to  mentally  integrate  multiple 
images  to  develop  a  3D  impression  of  the  scanned  objects.  This  practice  is  time-consuming,  inefficient,  and 
requires  a  highly  skilled  operator  to  administer  the  scanning  procedure.  Defence  R&D  Canada  (DRDC)  is 
developing  a  Portable  3D/4D  Ultrasound  Diagnostic  Imaging  System  (PUDIS)  to  address  the  above- 
mentioned  challenges.  Our  proposed  approach  to  address  the  con  ven  tional  2D  ultrasound  imaging  limitations 
is  to  implement  3D  adaptive  beamformers  in  portable  4D  ultrasound  imaging  systems,  that  can  improve 
image  resolution  for  low  frequency  planar  array  probes.  Along  these  lines,  DRDC  has  allocated  significant 
investments  to  develop  an  advanced,  fully-digital  4D  (3D-spatial  +  ID-temporal)  ultrasound  imaging 
technology  for  improving  image  resolution  and  facilitating  auto-diagnostic  applications  to  detect  non-visible 
internal  injuries,  based  on  the  volumetric  imaging  outputs  provided  by  a  4D  ultrasound  imaging  system  that 
includes: 

•  A  32x32  sensor  planar  array  ultrasound  probe  with  a  fully  digital  data  acquisition  peripheral; 

•  A  portable  ultrasound  computing  architecture  consisting  of  a  cluster  of  DSPs  and  CPUs; 

•  Adaptive  3D  beamforming  algorithms  with  volumetric  visualization,  including  fusion  and  automated 
segmentation  capabilities;  and 

•  The  implementation  of  a  decision-support  process  to  provide  automated  diagnostic  capabilities  for 
non-invasively  detecting  internal  injuries  and  facilitate  image  guided  surgery. 


1.0  INTRODUCTION 

The  fully  digital  3-Dimensional  (3D)/  (4D:  3D  +  time)  Ultrasound  System  Technology,  presented  in  this 
paper,  consists  of  a  set  of  adaptive  ultrasound  beamformers  [1-4]  that  have  been  discussed  in  detail  in  [3,6]. 
The  aim  with  this  signal  processing  structure  is  to  address  the  fundamental  image  resolution  problems  of 
current  ultrasound  systems  [6-8]  and  to  provide  suggestions  for  its  implementation  into  existing  2D  and/or  3D 
ultrasound  systems  as  well  as  develop  a  complete  stand-alone  3D  ultrasound  solution.  This  development  has 
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Program  (i.e.  ADUMS  project:  EC-IST-2001-34088). 

To  fully  exploit  the  advantages  of  the  present  fully  digital  adaptive  ultrasound  technology,  its  implementation 
in  a  commercial  ultrasound  system  requires  that  the  system  has  a  fully  digital  design  configuration  consisting 
of  A/DC  and  D/AC  peripherals  that  have  the  capability  to  digitize  the  ultrasound  probe  time  series,  to 
optimally  shape  the  transmitted  ultrasound  pulses  through  a  D/A  peripheral  and  to  integrate  linear  and/or 
planar  phase  array  ultrasound  probes. 

Thus,  the  digital  ultrasound  3D  beamforming  technology  of  this  paper,  can  replace  the  conventional  (i.e.  time 
delay)  beamforming  structure  of  ultrasound  systems  with  an  adaptive  beamforming  processing  configuration. 
The  results  of  this  development  [1,2,6]  demonstrate  that  adaptive  beamformers  improve  significantly  (at  very 
low  cost)  the  image  resolution  capabilities  of  an  ultrasound  imaging  system  by  providing  a  performance 
improvement  equivalent  to  a  deployed  ultrasound  probe  with  double  aperture  size  .  Furthermore,  the 
portability  and  the  low  cost  characteristics  of  the  present  3D  adaptive  ultrasound  technology  can  offer  the 
options  to  medical  practitioners  and  family  physicians  to  have  access  of  diagnostic  imaging  systems  readily 
available  on  a  daily  basis.  As  a  result,  a  digital  PC-based  ultrasound  technology  can  adjust  the  signal 
processing  configuration  of  ultrasound  devices  to  move  them  away  from  the  traditional  hardware  and 
implementation  software  requirements  and  to  be  able  to  accommodate  the  processing  requirements  of  the 
"traditional"  linear  array  2D  scans  as  well  as  the  advanced  matrix-arrays  performing  volumetric  scans. 

In  summary,  a  digital  PC-based  ultrasound  imaging  technology  can  provide  flexible  cost-to-image  quality 
adjustments.  The  resulting  systems  can  be  upgraded  on  a  continuous  base  at  very  low  cost  by  means  of 
software  and  hardware  improvements  by  exploiting  the  continuous  upgrades  and  CPU  performance 
improvements  of  the  PC  architectures. 

Thus,  to  maintain  a  reasonable  image  quality,  a  large  number  of  detector  elements  are  required,  and  the 
computational  load  is  directly  related  to  the  size  of  2-D  array  (i.e.  planar  array  ultrasound  probe)  used  to 
acquire  the  RF  time  series  for  beamforming. 

The  ability  to  image  volumes,  instead  of  slices  is  the  motivation  for  using  a  3-D  beamformer.  Currently  to 
generate  an  ultrasound  volume,  a  number  of  slices  are  collected.  These  slices  are  then  used  to  synthesize  a  3D 
volume.  Another  approach  is  to  use  2-D  array  probes  to  generate  3D  ultrasound  volumes,  but  to  counter  the 
increased  processing  load  brought  on  by  the  2-D  probe  the  resolution  in  one  of  the  directions  (x  or  y)  is 
compromised. 

As  stated  above,  the  core  of  the  system  design  presented  here  is  the  efficient  implementation  of  3D 
beamforming  that  greatly  simplifies  the  beamformer  processing.  This  implementation  makes  it  possible  to 
map  the  processing  onto  a  parallel  computing  architecture  like  the  multi-node  cluster  described  later.  The 
beamforming  algorithm  is  implemented  on  the  processing  cluster  along  with  a  versatile  data  control  unit  that 
controls  all  signal  transmission  and  reception  form  the  complete  3D/4D  Ultrasound  system. 

An  additional  complication  is  that  in  ultrasound  imaging  systems  the  angular  resolution  provided  by 
conventional  beamformers  is  determined  by  the  length  of  the  aperture  L,  and  by  the  frequency  of  the  received 
signals  [1,2,6].  Since  the  operating  frequency  is  usually  fixed,  only  the  aperture  length  can  be  eventually 
increased  by  a  higher  number  of  elements,  thus  leading  to  more  complex  hardware  and  software 
implementations.  The  alternative  is  to  employ  an  adaptive  beamforming  method.  Adaptive  beamformers  are 
designed  to  maximize  signal  detection,  while  minimizing  the  beam-width,  and  suppressing  the  side-lobes 
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[1,2,3]-  The  convergence  time  of  the  specific  method  adopted  allows  for  real-time  imaging  [6].  The  method 
uses  a  combination  of  the  Sub-Aperture  pre-processing  scheme  [4]  and  a  space-time  statistic  [3,4]  to  reduce 
the  degrees  of  freedom  required  by  the  algorithm. 


2.0  THE  BEAMFORMING  PROCESS  IN  3D/4D  ULTRASOUND  SYSTEMS 
2.1  Conventional  3D  Beamformer 

Consider  the  beamforming  process  for  an  N  x  M  detector  array  with  K  time  samples  collected,  the  data 
collected  is  given  by 

xnJtk),n  =  \,...N,m  =  l...M,k  =  l...K .  (1) 

The  time  domain  focused  beamformer  outputs  implemented  in  the  frequency  domain,  the  beam-time  series 
obtained  from  the  beamformer,  b(t  j,A,B,R)  =  IFFT\B{fi , A, 5, /?)],  is  given  by  (2),  where  the  parameters  are 

defined  in  Figure  1 . 


B(f,.,A,B,R)=£|;Xnm(fi).S„m(fi,A,B,R),  (2) 

n= 0  m= 0 

where  X«m(ft)  =  FFr[x«Jf})\  andthe  steering  vector  Snni(f,,  A, B,R)  =  cxp(./27rf,r„,„(/i,  B,  R))  . 

The  inter-element  time  delays  are  defined  by  (3). 

Vr2  +  xi  +  y2n  -  2xm  cos  A  -  2yn  cos  S  -  R 


„„(a,b,r)=- 


where  element  nm  is  located  at  position  (x„„y„). 


(3) 


Equation  3  indicates  that  for  each  beam  (A,B)  and  focal  depth  R  there  needs  to  be  MxN  complex  steering 
vectors  computed  for  each  frequency  bin  of  interest.  Furthermore  each  set  of  steering  vectors  Snm(f  , A, B,R) 

is  unique,  with  each  of  the  four  function  variable  independent  and  not  separable.  Because  of  this 
independence,  it  is  not  possible  to  decompose  this  beamformer  in  an  efficient  manner  [2,4]. 


Figure  1 :  Definition  of  Parameters. 
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The  approach  that  follows  presents  an  alternative  beamformer  that  is  an  approximation  to  the  beamformer  in 
(2)  [1,2,3].  This  implementation  allows  the  beamforming  equation  to  be  divided,  and  hence  decomposed, 
which  in  turn  allows  for  it  to  be  easily  implemented  on  a  parallel  architecture.  The  difference  between  this  3D 
implementation  and  the  efficient  beamformer  implementation  is  shown  in  (2)  and  (4),  where  (2)  is 
approximated  (4),  resulting  in  a  simplified  2-stage  implementation.  For  plane  wave  arrivals,  i.e.  R  — »  oo,  (4) 
can  be  directly  derived  from  (2)  and  the  derivation  is  exact.  For  (xm,y„)  the  exact  beamforming  delay  rnm  is 
approximated  to: 


r„m(A,B,R) 


-J R2  +  x2m  -2xmRcosA  -R 
c 

VR2  +y l  ~  2y„RcosB  -R 

c 


(4) 


The  decomposition  of  the  3D  beamforming  into  two  linear  steps  is  expressed  as  follows: 


B(f„A,B,R)  =  XS„(f;,B,R)- 


ivi— i 

ZXnm(f,.)-S,„(f,,A,R) 


with  the  two  separated  steering  vectors  expressed  as: 


S  (f, ,  A,  R )  =  exp-J  J2nfI 


-  2x  m  Rcos A  -  R 


S|,  (f i  >  B .  R )  =  exp  w2  jrff 


-Jr  1  +  y,]  -  2ynRcosB  -  R 


(5) 


The  summation  in  square  brackets  is  equal  to  a  line  array  beamformer  along  the  X-axis.  This  term  is  a  vector 
which  can  be  denoted  as  B„  (f; ,  A,  R) .  This  can  then  be  rewritten  as  follows: 


B(f, .  A,  B,R)  =  ^B,,  (f, .  A,  R)S„  (f, ,  B,R)  (6) 

n= 0 

This  expression  is  equal  to  a  linear  beamforming  along  the  Y-axis,  with  B„(f,,  A,  R)  as  input.  This  2  stage 
implementation  is  easily  parallelized  and  implemented  on  a  multi-node  system.  In  this  approximate 
implementation,  the  error  introduced  at  angles  A  and  B  close  to  broadside  is  negligible.  Side  by  side 
comparisons  show  that  there  is  no  degradation  in  image  quality  over  the  exact  implementation  for  this 
application. 

2.2  Adaptive  Beamforming 

The  beamforming  method  presented  in  this  paper  is  based  on  the  class  of  Linear  Constrained  Minimum 
Variance  (LCMV)  adaptive  beamformers  [1,2, 3, 4], 
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Consider  a  linear  phased  array  of  N  transducers,  with  0O  steering  angle.  The  optimum  beam-steering  vector, 
W(f,,0o),  is  solution  of  a  constrained  minimization  problem  [4],  The  cost  function  is: 

<4vMo)  =  wH(f;,e0)  •  ®(f0,e„)-  w(f;,e0)  (7) 

where  Hdenotes  the  complex  conjugate  transpose.  ®(f0, 0O )  is  the  Steered  Covariance  Matrix  (STCM):  it  is  a 
space-time  statistic,  exploiting  the  signals’  characteristics  both  in  frequency  and  in  time  [3,4].  For  a  band  of 
width  Af  centred  at  f0,  the  STCM  for  the  bins  at  f0  and  the  steering  angle  0O  is  defined  as: 

f0+Af/ 

®(f0  ■  00 )  =  X  te  )• ; D(f/  ’ °o )]  ■  [x(f,  )-D(f, , 00  )f  (8) 

where  .  denotes  element-by-element  multiplication.  x(f,  )  is  an  Nxl  vector,  containing  for  each  nth  transducer 
of  the  array  the  corresponding  sample  X„(f,),  as  defined  by  (1)  and  D(f,,0o)is  the  conventional  steering 
vector  for  a  line  array,  which  is  different  than  that  defined  by  Eqs.  (2)  &  (5).  The  constraint  to  be  fulfilled  by 
the  steering  vector  is: 

WH(f,,0o)  •  D(f;,0o)  =  1  (9) 

The  method  based  on  the  STCM  is  called  Steered  Minimum  Variance  algorithm  (STMV). 

Assuming  stationarity  across  the  frequency  bins  of  a  band  Af  ,  then  for  each  frequency  bin  in  Af  the  STCM 
may  be  considered  to  be  approximately  the  same  as  the  narrowband  estimate  ®(fo,0o)  for  the  centre 
frequency  f0  of  the  band  Af  .  For  each  bin  f,  in  Af  ,  the  adaptive  coefficients  are  then  given  by  the  following 
expression: 


w(f„e0) 


oMo^-dMq) 

DH(f,.,0o)-®(fo,0or''D(f/,eo) 


(10) 


This  method  is  called  Steered  Minimum  Variance  Narrowband  Algorithm  [1-3].  The  adaptive  beam  is  then 
obtained  as: 


B(f,,0o)  =  WH(f;,0o)  •  X(f,)  (11) 

It  has  been  shown  [3]  that  for  broad-band  sources  this  method  achieves  lower  convergence  times  than  other 
adaptive  beamformers.  The  reader  is  referred  to  [1-4]  for  further  information  on  near-instantaneous 
convergence  beamforming. 


3.0  IMPLEMENTATION 

The  hardware  components  designed  to  complement  the  efficient  beamformer  defined  in  Section  2.0,  is  a  data 
acquisition  unit  that  supports  a  16  x  16  planar  array  probe,  and  the  scaleable  multi -node  cluster.  The 
implementations  of  the  individual  functional  components  of  the  system  are  described  in  this  section. 
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3.1  Transmit  Functionality 

The  philosophy  of  the  energy  transmission  module  is  to  illuminate  the  entire  volume  of  interest  with  a  few 
firings.  This  is  shown  in  Figure  2.  Here  the  volume  is  illuminated  in  3x3  sectors,  meaning  a  total  of  9 
firings.  The  transmitted  signals  are  all  broadband  FM  (chirp)  signals.  They  are  fired  with  inter-element  delays 
to  allow  the  transmitted  energy  to  be  focused  at  specific  regions  in  space,  e.g.  the  space  highlighted  by  the 
square  shaded  areas  of  Figure  2.  The  energy  transmission  is  done  through  the  6x6  elements  at  the  center  of 
the  array.  The  transmit  patterns  are  loaded  into  the  memory  of  the  data  acquisition  unit  and  delivered  to  the 
probe  via  the  D/A  portion  of  the  unit  when  a  trigger  signal  is  received. 


Figure  2:  The  Phased  Array  Transmit  Function  of  the  Planar  Array  Probe. 


In  addition,  FM  pulses  that  occupy  different  non-overlapping  frequency  regimes  may  be  coded  together  to 
illuminate  different  focal  depths  with  a  single  firing.  This  means  that  it  can  be  arranged  so  that  one  frequency 
regime  can  focus  and  illuminate  the  lower  shaded  square,  and  a  second  frequency  regime  the  upper  shaded 
square  in  Figure  2. 

The  use  of  fewer  beams  to  illuminate  the  volume  of  interest  however  leads  to  a  non-uniform  energy 
distribution  in  space.  This  requires  the  application  of  a  linearization  function  to  correct  for  this  type  of  non¬ 
uniformity.  A  correction  function  is  derived  from  the  illuminating  beam  shapes  and  is  used  later  for 
linearization  of  the  results  of  the  beamformer.  An  example  of  a  linearization  function  is  shown  in  Figure  3. 
This  figure  shows  the  correction  function  that  would  be  applied  to  the  output  for  a  4  x  4  sector  illumination. 
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Figure  3:  Correction  function  for  4  x  4  sectors  illumination  pattern. 


3.2  The  Beamformer 

The  2-stage  beamformer  described  by  Equations  (4)  and  (5)  is  implemented  as  shown  in  Figure  4  [3].  The 
beamforming  process  is  a  two  stage  process  where  the  rows  are  treated  as  line  arrays  and  beamformed 
accordingly.  The  results  of  this  first  stage  of  beamforming  are  again  treated  as  line  arrays  and  beamformed. 
Figure  4  outlines  this  process.  Each  row  of  the  array  is  sent  to  a  line  array  beamformer,  which  includes 
transforming  the  signals  to  the  frequency  domain  through  the  FFT,  applying  a  filter  and  steering  the  azimuth 
beams.  The  azimuth  beams  are  then  grouped,  and  for  a  fixed  azimuth  beam,  the  results  of  all  of  the  rows  are 
then  sent  to  the  second  stage  of  line  array  beamforming.  This  second  stage  includes  steering  the  elevation 
beams  and  transferring  the  results  back  to  the  time  domain.  For  every  azimuth  beam  a  series  of  elevation 
beams  are  created  [1,2, 3, 6]. 
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Figure  4:  Block  Diagram  showing  the  2  Stage  Implementation  of  the  3D  beamformer. 

The  implementation  shown  in  Figure  4  is  easily  realizable  on  a  parallel  system.  The  first  stage  beamforming  is 
distributed  to  the  computing  nodes.  In  the  simplest  sense  each  row  of  data  is  distributed  to  a  separate  node  and 
processed.  The  results  are  then  regrouped  and  again  each  group  sent  to  a  separate  node  for  the  second  stage 
before  the  displaying. 
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3.3  The  Multi-Node  Cluster 

The  multi-node  cluster  developed  for  the  beamforming  process  is  built  of  a  series  of  commodity  personal 
computers  (PCs)  connected  via  a  Myrinet  high  speed  fiber-optic  network  for  data  transfer.  An  Ethernet 
network  is  also  used  for  control  messages  [6,9].  The  layout  and  interconnections  of  the  components  of  this 
computing  cluster  is  shown  in  Figure  5.  The  data  acquisition  unit  delivers  the  acquired  data  to  the  PCI  bus  of 
the  individual  nodes  as  shown  in  Figure  5. 


Cluster  of  PCs  with  Myrinet  Network 


Figure  5:  Layout  of  the  computing  cluster. 


3.4  Computing  Architecture  and  Implementation  Issues 

Implementation  of  a  fully  digital  3D  adaptive  beamforming  structure  in  ultrasound  systems  is  a  non-trivial 
issue.  In  addition  to  the  selection  of  the  appropriate  algorithms,  success  is  heavily  dependent  on  the 
availability  of  suitable  computing  architectures. 

Past  attempts  to  implement  matrix  based  signal  processing  methods,  such  as  adaptive  beamformers,  were 
based  on  the  development  of  systolic  array  hardware  because  systolic  arrays  allow  large  amounts  of  parallel 
computation  to  be  performed  efficiently  since  communications  occur  locally.  None  of  these  ideas  are  new. 
Unfortunately  systolic  arrays  have  been  much  less  successful  in  practice  than  in  theory.  The  fixed  size 
problem  for  which  it  makes  sense  to  build  a  specific  array  is  rare.  Systolic  arrays  big  enough  for  real  problems 
cannot  fit  on  one  board,  much  less  one  chip,  and  interconnects  have  problems.  A  2-D  systolic  array 
implementation  will  be  even  more  difficult.  So,  any  new  computing  architecture  development  should  provide 
high  throughput  for  vector  as  well  as  matrix  based  processing  schemes. 

A  fundamental  question,  however,  that  must  be  addressed  at  this  point  is  whether  it  is  worthwhile  to  attempt 
to  develop  a  dedicated  architecture  that  can  compete  with  a  multiprocessor  using  stock  microprocessors. 
However,  the  experience  gained  from  sonar  computing  architecture  developments  [4]  suggests  that  a  cost 
effective  approach  in  that  direction  is  to  develop  a  PC-based  computing  architecture  that  will  be  based  on  the 
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rapidly  evolving  microprocessor  technology  of  the  CPUs  of  PCs.  Moreover,  the  signal  processing  flow  of 
advanced  processing  schemes  that  include  both  scalar  and  vector  operations  should  be  very  well  defined  in 
order  to  address  practical  implementation  issues.  When  the  signal  processing  flow  is  well  established,  such  as 
in  Figures  4  and  5,  then  distribution  of  the  signal  processing  flow  in  a  number  of  parallel  CPU’s  will  be 
straightforward.  In  the  following  sections,  we  address  the  practical  implementation  issues  by  describing  the 
current  effort  of  developing  an  experimental  fully  digital  3D/4D  ultrasound  system  deploying  a  planar  array  to 
address  the  requirements  of  the  Canadian  Forces  for  non-invasive  portable  diagnostic  devices  deployable  in 
fields  of  operations. 

3.5  Technological  Challenges  for  Fully  Digital  Ultrasound  System  Architecture 

The  current  state-of-the-art  in  high-resolution,  digital,  3D  ultrasound  medical  imaging  faces  two  main 
challenges: 

First,  the  ultrasound  signal  processing  structures  are  computationally  demanding.  Traditionally,  specialized 
computing  architectures  and  hardware  have  been  used  to  provide  the  levels  of  performance  and  I/O 
throughput  required,  resulting  in  high  system  design  and  ownership  costs.  With  the  emergence  of  high-end 
workstations  and  low-latency,  highbandwidth  interconnects  [9],  it  now  becomes  interesting  and  timely  to 
investigate  if  such  technologies  can  be  used  in  building  low-cost,  high-resolution,  3D  ultrasound  medical 
imaging  systems. 

Second,  although  beamforming  algorithms  in  digital  configuration  have  been  studied  in  the  context  of  other 
applications  [4,6],  little  is  known  about  their  computational  characteristics  with  respect  to  ultrasound-related 
processing,  and  medical  applications  in  general.  It  is  not  clear  which  parts  of  these  algorithms  are  the  most 
demanding  in  terms  of  processing  or  communication  and  how  exactly  they  can  be  mapped  on  modem  parallel 
PC-based  architectures.  In  particular,  although  the  algorithmic  complexity  of  different  sections  can  be 
calculated,  little  has  been  done  in  terms  of  actual  performance  analysis  on  real  systems.  The  lack  of  such 
knowledge  inhibits  further  progress  in  this  area,  since  it  is  not  clear  how  these  algorithms  should  evolve  to 
lead  to  applicable  solutions  in  the  area  of  ultrasound  medical  imaging. 

The  previous  sections  of  this  paper  addresses  both  these  two  issues  by  introducing  a  design  of  a  parallel 
implementation  of  the  advanced  3D  beamforming  algorithms  of  [9]  and  studying  its  behavior  and 
requirements  on  a  generic  computing  architecture  that  consists  of  commodity  components. 

This  design  concept  provides  an  efficient,  all-software,  sequential  implementation  that  shows  considerable 
advantages  over  hardware-based  implementation  of  the  past.  It  provides  also  an  efficient  parallel 
implementation  of  the  advanced  3D  beamforming  of  [6]  for  a  cluster  of  high-end  PCs  connected  with  a 
lowlatency,  high-bandwidth  interconnection  network  that  allows  also  for  an  analysis  of  its  behaviour  [9] .  The 
emphasis  in  this  design  has  been  placed  also  on  the  identification  of  parameters  that  critically  affect  both  the 
performance  and  cost  of  ultrasound  system. 

The  end  result  reveals  a  number  of  interesting  characteristics  leading  to  conclusions  about  the  prospect  of 
using  commodity  architectures  for  performing  all  related  processing  in  ultrasound  imaging  medical 
applications.  A  brief  summary  of  these  findings  suggests  the  following: 

•  A  PC-based  16-processor  system  today  can  achieve  close-to-real-time  performance  for  high-end 
ultrasound  image  quality  and  is  certainly  expected  to  do  so  in  the  near  future  [9] . 

•  The  major  components  of  the  digital  3D  ultrasound  beamforming  signal  processing  structure  of  [9] 
that  are  very  computationally  intensive  consist  of: 
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•  85-98%  of  the  time  is  spent  in  FFT  and  beam  steering  functions. 

•  The  communication  requirements  in  the  particular  implementation  are  fairly  small,  localized,  and 
certainly  within  the  capabilities  of  modern  low-latency,  high-bandwidth  interconnects. 

•  The  results  of  this  section  provide  an  indication  of  the  amount  of  processing  required  for  a  given 
level  of  ultrasound  image  quality  and  number  of  channels  in  a  probe  and  can  be  used  as  a 
reference  in  designing  computing  architectures  for  ultrasound  systems. 


4.0  EXPERIMENTAL  RESULTS 
4.1  System  Overview 

The  experimental  configuration  of  the  fully  digital  ultrasound  imaging  concept  included  two  versions.  The 
first  was  configured  to  be  integrated  with  a  linear  phase  array  ultrasound  probe  and  it  is  depicted  in  Figure  6. 
This  is  a  fully  digital  ultrasound  system  which  includes  the  linear  array  probe  (64  elements)  and  the  2 -node 
data  acquisition  unit  including  two  Mini-PCs  that  control  the  transmitting  and  receiving  functions.  This  linear 
array  ultrasound  system  was  configured  also  to  provide  3D  images  through  volume  rendering  of  the  B-scan 
outputs  as  defined  in  [5].  A  USB  communication  protocol  allowed  the  transfer  of  the  B -scans  (2D  digital 
images)  as  inputs  to  the  visualization  software  for  3D  volume  rendering  [5]  installed  in  the  portable  PC.  More 
specifically,  the  experimental  linear  array  ultrasound  system  can  provide  3D  volumetric  images  from  a  series 
of  B-scan  (2D)  outputs.  The  magnetic  tracker  system,  provides  the  co-ordinates  of  the  probe  for  each  of  the 
acquired  image  frames  (B-scans).  This  tracker  provides  translational  (x,  y  and  z)  as  well  as  rotational  co¬ 
ordinates  with  respect  to  the  x,  y  and  z,  axes. 


Figure  6:  The  experimental  linear  phase  array  (64-element)  ultrasound  imaging  system 
integrated  with  a  Laptop  computer  to  provide  visualization  functionalities. 
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The  second  configuration  is  a  fully  digital  planar  phase  array  volumetric  ultrasound  imaging  system,  depicted 
in  Figure  7.  The  multi-node  computing  cluster  that  allows  for  an  effective  implementation  of  the  3D 
beamforming  structure  is  shown  at  the  lower  part  of  this  figure.  The  top  left  image  in  Figure  7  shows  the 
planar  phase  array  probe  and  the  top  right  image  presents  the  data  acquisition  unit  with  the  A/D  and  D/A 
peripherals  controlled  by  the  multi-node  cluster. 

Implementation  of  the  3D  beamforming  structure  and  communication  requirements  relevant  with  the  system 
configuration  of  Figure  7,  have  been  discussed  already  in  the  previous  sections. 

Figure  8  shows  a  schematic  representation  of  the  main  components  of  the  fully  digital  real  time  planar  array 
ultrasound  imaging  system  that  summarizes  the  developments  that  have  been  presented  in  the  previous 
sections.  It  depicts  a  256:  (16x16)  element  phased  array  probe,  a  A/DC  with  64  channel  data  acquisition  unit 
that  through  multiplexing  acquires  time  series  signals  for  the  256  channels,  and  a  computing  architecture  to 
process  the  acquired  time  series  into  ultrasound  volumes,  shown  also  in  Figure  7.  In  addition  the  system  uses  a 
36-channel  digital  to  analog  converter  (D/AC)  to  excite  the  center  (6x6)  transducers  of  the  planar  array  during 
the  illumination  process.  The  transmit  functionality  that  address  the  pulse  design  to  illuminate  at  various 
depths  simultaneously  is  addressed  in  a  subsequent  section.  The  inter-element  spacing  of  the  probe  is  0.4mm 
in  both  directions.  This  combination  forms  the  front  end  of  the  3-D  ultrasound  system  that  will  support  the 
transmit  functions  and  the  receiving  functions  required  for  the  3-D  beamforming.  The  probe  is  attached  to  the 
data  acquisition  unit  via  an  interface  card.  This  card  provides  the  means  of  data  flow  into  and  out  of  the  probe 
through  the  data  acquisition  system. 

The  computing  cluster  (Figure  7)  that  implements  the  3D  beamformer  software  (Figure  8)  has  already  been 
introduced  in  the  previous  section.  This  is  the  multi-node  cluster  that  was  designed  to  allow  for  easy 
implementation  of  the  3-D  beamformer  algorithms  -  both  conventional  and  adaptive.  The  integrated 
hardware  platform  in  Figure  7  brings  together  the  planar  array  probe,  the  data  acquisition  unit  for  the  planar 
array  probe  and  the  multi-node  PC  cluster. 


RTO-MP-HFM-1 82 


27-11 


Portable  3D/4D  Ultrasound  Diagnostic  Imaging  System 


Figure  7:  The  multi-node  computing  cluster  that  allows  the  implementation  of  the  parallel  beamforming 
structure  of  the  experimental  planar  phase  array  ultrasound  imaging  system  is  shown  at  the 
lower  part  of  this  figure.  The  top  left  image  shows  the  planar  phase  array  probe  and 
the  top  right  image  depicts  the  data  acquisition  unit  with  the  A/D  and  D/A 
peripherals  (with  probe  attached)  controlled  by  the  multi-node  cluster. 


The  A/DC  is  well  grounded  and  capable  to  sample  the  64  channels  with  an  equivalent  14-bit  resolution  and  33 
MHz  sampling  frequency  per  channel.  Moreover,  the  unit  has  dedicated  memory  and  separate  bus-lines.  The 
D/AC  is  capable  to  drive  36  channels  with  12-bit  resolution  and  33  MHz  sampling  frequency.  The  period 
between  two  consecutive  active  transmissions  is  in  the  range  of  0.2  ms.  Moreover,  the  local  memory  of  the 
D/AC  unit  has  the  capability  to  store  the  active  beam  time  series  with  total  memory  size  of  1.35  Mb,  being 
generated  by  the  main  computing  architecture  for  each  focus  depth  and  transferred  to  the  local  D/AC  memory 
when  the  transmission-acquisition  process  begins. 

The  digitization  process  of  the  16x4  sub-apertures  by  the  14-bit  64-channel  A/D  unit,  provide  the  signals  to  a 
system  of  pin  connectors-cables  with  suppressed  cross-talk  characteristics  (minimum  35  dB).  The  sampling 
frequency  is  33  MHz  for  each  of  the  channels  associated  with  a  receiving  single  sensor.  The  multiplexer 
associated  with  the  A/DC  allows  the  sampling  of  the  16x4-sensors  of  the  planar  array  in  four  consecutive 
active  transmissions  to  be  able  to  digitize  the  16x16  planar  array  channels. 
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Computing  Architecture  Requirements  for  Volumetric  3D  U/S  Imaging 
System  Using  Planar  Phase  Arrays 


Figure  8:  Structure  of  the  PC-based  computing  schematic  representation  of  the  main 
components  including  the  data  acquisition  units  of  a  fully  digital 
real  time  planar  array  ultrasound  imaging  system. 


The  computing  architecture,  (Figure  8),  includes  sufficient  data  storage  capabilities  for  the  sensor  time  series. 
The  A/DC  and  signal  conditioning  modules  of  the  data  acquisition  process  and  the  communication  interface 
are  controlled  through  S/W  drivers  that  form  an  integral  part  of  the  computing  architecture. 

It  has  been  assessed  that  the  ultrasound  adaptive  3D  beamforming  structure,  defined  in  [3],  provides  an 
effective  beam-width  size,  which  is  equivalent  to  that  of  a  two  to  three  times  longer  aperture  along  azimuth 
and  elevation  of  the  deployed  planar  array.  Thus,  for  the  deployed  receiving  16x16  planar  array,  the  adaptive 
beamformer’s  beamwidth  characteristics  will  be  equivalent  with  those  of  a  (16x2)x(16x2)  size  planar  array. 
For  example,  the  beam-width  of  a  receiving  16x16  planar  array  with  element  spacing  of  0.5  mm  for  a  3  MHz 
centre  frequency,  is  approximately  7.4°,  with  effective  angular  resolution  by  the  adaptive  beamformer  in  terms 
of  beam-width  size,  to  be  less  than  3.7°  x  3.7°.  As  a  result,  the  receiving  adaptive  beams  along  azimuth  will 
have  the  following  image  resolution  capabilities: 
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•  For  C-scan  and  for  depth  of  10  cm,  the  3.7°  x  3.7°  angular  resolution  sector  corresponds  to  a  (0.64 
cm)  x  (0.64  cm)  =  0.41  cm2  size  of  tissue  resolution,  or  for  depth  of  5  cm  to  a  (0.32  cm)  x  (0.32 

cm)  =  0.10  cm2  size  of  tissue  resolution. 

•  For  B-scan  the  line  resolution  will  be  equivalent  to  the  wavelength  of  the  transmitted  centre 
frequency  ,  which  is  0.5  mm. 

•  Thus,  the  volume  resolution  of  the  3D  adaptive  beamforming  structure  will  be  equivalent  to  (10.2 
mm2 )  x  (0.5  mm)  =  5.12  min',  in  3D  tissue  size  at  a  depth  of  5  cm. 

The  concept  of  the  energy  transmission  module  to  illuminate  the  entire  volume  of  interest  with  a  few  firings, 
has  been  introduced  in  [6]  and  depicted  in  Figure  2.  Here  the  volume  is  illuminated  in  sub-sectors.  The 
transmitted  signals  are  all  broadband  FM  (chirp)  signals.  They  are  fired  with  inter-element  delays  to  allow  the 
transmitted  energy  to  be  focused  at  specific  regions  in  space,  (e.g.  the  space  highlighted  by  the  square  shaded 
areas  of  Figure  2).  The  energy  transmission  is  done  through  the  6x6  elements  at  the  center  of  the  array.  The 
transmit  patterns  are  loaded  into  the  memory  of  the  data  acquisition  unit  and  delivered  to  the  probe  via  the 
D/AC  portion  of  the  unit  when  a  trigger  signal  is  received.  In  addition,  FM  pulses  that  occupy  different  non¬ 
overlapping  frequency  regimes  may  be  coded  together  to  illuminate  different  focal  depths  with  a  single  firing. 
This  means  that  it  can  be  arranged  so  that  one  frequency  regime  can  focus  and  illuminate  the  lower  shaded 
square,  and  a  second  frequency  regime  the  upper  shaded  square  in  Figure  2. 

Suppose  three  focal  depths  dj  <  d2  <  d3  are  desired.  Then,  three  separate  sets  of  transmit  patterns  are  created. 
The  first  set  of  transmit  patterns  with  the  appropriate  delay  profiles  that  occupy  the  lowest  frequency  band  are 
designed  to  focus  at  depth  d3.  A  second  set  of  transmit  patterns  with  delay  profiles  to  focus  at  depth  d2  are 
designed  to  occupy  a  second  frequency  band  higher  than  the  first  and  with  no  frequency  overlap.  Similarly,  a 
third  set  of  transmit  patterns  are  designed  to  focus  at  focal  depth  d,.  This  third  set  of  patterns  is  designed  to 
occupy  the  highest  frequency  band  since  they  will  illuminate  the  shallow  regions  of  the  medium  of  interest. 
When  the  design  of  the  three  sets  of  transmit  patterns  is  complete  they  are  superimposed  to  create  a  single 
transmit  pattern.  This  composite  transmit  pattern  is  used  to  provide  the  illumination  as  described  in  Figure  2. 
However,  the  requirement  to  use  the  smallest  possible  number  of  illumination  beams  leads  to  a  non-uniform 
energy  distribution  in  space.  This  requires  the  application  of  a  linearization  function  to  correct  for  this  type  of 
non-uniformity.  A  correction  function  is  derived  from  the  illuminating  beam  shapes  and  is  used  later  for 
linearization  of  the  results  of  the  beamformer.  An  example  of  a  linearization  function  is  shown  in  Figure  4. 
This  figure  shows  the  correction  function  that  would  be  applied  to  the  output  of  a  4  x  4  sub-sector 
illuminations. 

4.2  Performance  Results 

Presented  in  this  section  are  the  image  output  results  from  the  linear  phase  array  (e.g.  64-elements,  2D/3D) 
and  the  planar  phase  array  probes  (e.g.  16x16,  3D/4D).  While  numerous  experiments  were  carried  out,  only  a 
few  typical  image/volume  outputs  for  both  the  adaptive  and  conventional  image  results  are  presented  here.  All 
these  image  results  are  from  the  standard  ultrasound  “test  target”  termed  as  phantom,  the  cross  section  of 
which  is  shown  in  Figure  28. 
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4.3  Portable  2D/3D  Experimental  System  with  Linear  Phased  Array  Probe 
4.3.1  B-Scan  Results 

Figure  10  shows  two  typical  images  from  the  portable  2D/3D  system  operating  in  B-scan  mode.  The  left  hand 
image  shows  the  image  obtained  using  the  conventional  beamforming  technique  and  the  right  hand  image 
shows  the  image  output  from  the  adaptive  beamformer.  Both  images  are  obtained  by  placing  the  probe  on  the 
top  of  the  phantom  just  above  the  “Dead  Zone”  label.  The  phantom’s  vertical  row  of  reflectors  and  the  curved 
arrangement  are  depicted  in  both  images  that  show  no  “ghosting”  or  blurring  of  these  strong  reflectors. 

The  next  figure  1 1  provides  a  comparison  of  the  B-scan  outputs  from  a  commercial  ultrasound  imaging 
system  and  the  experimental  prototype  of  this  investigation  depicted  in  Figure  6.  The  images  for  both  systems 
are  obtained  by  placing  the  probes  on  the  left  side  of  the  phantom  just  beside  the  “Resolution  Array”  label. 
Both  systems  use  the  same  probe  (64-channels).  However,  the  commercial  system  operates  at  4  MHz  while 
the  experimental  system  in  Figure  6  operates  at  2  MHz.  The  left  hand  side  image  (Figure  11a)  shows  the 
output  of  the  adaptive  beamformer  at  2  MHz  while  Figure  lib  shows  the  image  output  from  the  commercial  4 
MHz  ultrasound  system. 


RTO-MP-HFM-1 82 


27-15 


Portable  3D/4D  Ultrasound  Diagnostic  Imaging  System 


Figure  10:  B-scan  image  results  for  both  the  Conventional  (Left  Hand  Side  Image)  and  Adaptive 
(Right  Hand  Side  Image)  beamformers  of  the  experimental  linear  phase  array 
(64-element)  ultrasound  imaging  system,  depicted  in  Figure  6. 


Figure  11 :  The  left  hand  side  image  (30a)  shows  the  B-scan  output  of  the  adaptive  beamformer 
for  the  same  phantom  as  in  Figure  29,  illuminated  at  2  MHz.  The  right  hand  side  image 
(30b)  shows  the  output  of  a  commercial  system  using  the  same  probe  at  4  MHz. 

It  can  be  seen  from  the  image  results  of  Figure  1 1  that  the  adaptive  beamforming  scheme  of  this  investigation 
performs  quite  as  good,  if  not  even  better,  with  respect  to  the  ultrasound  commercial  system,  in  terms  of  both 
resolution  of  the  strong  scatterers,  and  noise  in  the  bulk  image.  It  should  furthermore  be  considered  that  the 
images  obtained  with  the  prototype  of  this  investigation  have  been  acquired  using  a  2MHz  probe,  whereas  a 
4MHz  probe  has  been  employed  for  the  image  output  (Figure  1 1  b)  of  the  commercial  system. 

The  transmission/acquisition  schemes  adopted  by  the  experimental  2D/3D  prototype  system  allow  to  cover  a 
wide  scanning  angle  (90°-120°),  a  characteristic  which  can  be  very  useful  in  cardiac  imaging  applications. 
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Furthermore,  the  deployment  of  low  frequencies  in  the  range  of  2  MHz  can  achieve  the  deep  penetration 
depths  which  are  required  in  cardiologic  ultrasound  applications. 

4.3.2  Volumetric  2D/3D  Imaging 

The  volumetric  images  created  from  the  2D/3D  system  are  shown  in  Figure  12.  This  figure  shows  cross 
sections  of  the  3D  output  from  volume  redering  of  B-scan  images  using  the  techniques  discussed  in  [5].  In 
particular,  Figure  1 1  shows  the  volume  obtained  using  the  standard  ultrasound  phantom  of  Figure  9.  In  this 
experiment  the  volume  is  taken  along  the  top  surface  of  the  phantom.  The  top  right  panel  in  Figures  12  shows 
the  full  reconstructed  volume.  The  remaining  3  panels  show  three  orthogonal  views  of  the  volume  scanned. 
The  visualization  software  is  discussed  in  [5] . 

Although  the  experimental  2D/3D  system  in  Figure  6  includes  a  fully  digital  ultrasound  technology  with  an 
advanced  beamforming  structure  implemented  in  frequency  domain,  this  system  has  been  reduced  to  a 
portable  size,  compared  to  nowadays  commercial  ultrasound  units. 


Figure  12:  The  3D  volume  is  taken  along  the  top  surface  of  the  phantom  shown  in  Figure  28. 
The  top  right  panel  shows  the  full  reconstructed  volume.  The  remaining 
3  panels  show  three  orthogonal  views  of  the  volume  scanned. 


4.3.3  3D/4D  Experimental  System  with  Planar  Phase  Array  Probe 

The  volumes  created  from  the  3D/4D  system,  deploying  the  planar  (16x16)  phase  array  probe,  are  shown  in 
Figures  13  and  14.  Figure  13  shows  the  volume  derived  from  the  3D  conventional  beamformer  and  Figure  14 
presents  the  output  of  the  3D  adaptive  beamformer.  The  volumes  in  both  figures  are  obtained  by  placing  the 
probe  on  the  left  side  of  the  phantom  just  beside  the  “Resolution  Array”  label.  The  top  right  panel  in  Figures 
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32  and  33  show  the  full  reconstructed  volume  in  each  case.  The  remaining  3  panels  show  three  orthogonal 
views  of  the  volume  scanned. 

Like  the  portable  ultrasound  2D/3D  unit,  the  experimental  3D/4D  system  deploying  a  planar  phase  array 
probe  has  the  capability  of  performing  both  conventional  as  well  as  adaptive  beamforming,  and  both  the 
modules  are  integrated  into  the  parallel  processing  scheme  discussed  in  this  report.  Furthermore,  the  3D/4D 
system  is  also  capable  of  frequency  coding  for  multi-zone  focusing,  and  of  applying  deblurring  algorithms  for 
enhancing  the  image  quality.  Both  experimental  systems  (e.g.  2D/3D,  3D/4D)  show  good  performances  in 
terms  of  scanning  angle  apertures,  penetration  depth  and  image  quality.  As  expected,  the  adaptive 
beamforming  scheme  implemented  into  the  3D  parallel  architecture  seems  to  allow  for  a  higher  image  quality 
with  respect  to  conventional  beamforming  for  what  concerns  the  axial  and  contrast  resolutions. 


Figure  13:  Reconstructed  3D  volume  from  the  beam  time  series  of  the  3D  conventional  beamformer. 
The  top  right  panel  shows  the  full  reconstructed  volume.  The  remaining  3  panels 
show  three  orthogonal  views  of  the  volume  scanned. 
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Figure  14:  Reconstructed  3D  volume  from  the  beam  time  series  of  the  3D  adaptive  beamformer.  The 
volumes  in  both  figures  13  and  14  are  obtained  by  placing  the  probe  on  the  left  side  of  the  phantom 
just  beside  the  “Resolution  Array”  label.  The  top  right  panel  shows  the  full  reconstructed 
volume.  The  remaining  3  panels  show  three  orthogonal  views  of  the  volume  scanned. 


5.0  CONCLUSION 

The  fully  digital  ultrasound  system  technology  discussed  in  this  paper  consists  of  a  set  of  unique  adaptive 
ultrasound  beamformers  [1,2,3],  a  PC -based  computing  architecture  and  a  set  of  visualization  tools,  presented 
in  [3,6,9],  addressing  the  fundamental  image  resolution  problems  of  current  3D  ultrasound  systems.  The 
results  of  this  development  can  be  integrated  into  existing  2D  and/or  3D  ultrasound  systems  or  they  can  be 
used  to  develop  a  complete  stand-alone  3D  ultrasound  system  solution. 

It  has  been  well  established  [6]  that  the  existing  limitations  of  medical  ultrasound  imaging  systems  in  poor 
image  resolution,  is  the  result  of  the  very  small  size  of  deployed  arrays  of  sensors  and  the  distortion  effects  by 
the  influence  of  the  human-body’s  non-linear  propagation  characteristics.  The  ultrasound  technology, 
discussed  in  this  paper,  replaces  the  conventional  (time  delay)  beamforming  structure  of  ultrasound  systems 
with  an  adaptive  beamforming  processing  configuration  that  has  been  developed  for  sonar  array  systems.  The 
results  of  this  development  [1-3, 6-8]  have  demonstrated  that  these  novel  adaptive  beamformers  improve 
significantly  (at  very  low  cost)  the  image  resolution  capabilities  of  an  ultrasound  imaging  system  by  providing 
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a  performance  improvement  equivalent  to  a  deployed  ultrasound  probe  with  double  aperture  size  . 
Furthermore,  the  portability  and  the  low  cost  for  the  3D  ultrasound  systems  offer  the  options  to  medical 
practitioners  and  family  physicians  to  have  access  of  diagnostic  imaging  systems  readily  available  on  a  daily 
basis. 

At  this  point,  however,  it  is  important  to  note  that  in  order  to  fully  exploit  the  advantages  of  this  digital 
adaptive  ultrasound  technology,  its  implementation  in  a  commercial  ultrasound  system  requires  that  the 
system  has  a  fully  digital  design  configuration  consisting  of  A/DC  and  D/AC  peripherals  that  would  fully 
digitize  the  ultrasound  probe  time  series,  they  will  optimally  shape  the  transmitted  ultrasound  pulses  through  a 
D/A  peripheral  and  they  will  use  phase  array  linear  or  matrix  ultrasound  probes. 

In  other  words,  the  present  ultrasound  technological  alternative,  revises  the  signal  processing  configuration  of 
ultrasound  devices  and  moves  it  away  from  the  traditional  hardware  and  implementation  software 
requirements. 

Thus,  implementation  of  the  adaptive  beamformer  is  a  software  installation  on  a  PC-based  ultrasound 
computing  architecture  with  sufficient  throughput  for  3D  and  4D  ultrasound  image  processing.  As  a  result, 
the  ultrasound  computing  architecture,  discussed  in  this  report,  is  able  to  accommodate  the  processing 
requirements  of  the  "traditional"  linear  array  2D  scans  as  well  as  the  advanced  matrix-arrays  performing 
volumetric  scans. 

In  addition,  the  use  of  adaptive  ultrasound  beamformers,  provides  significantly  better  image  resolution  than 
the  traditional  time  delay  based  beamformers.  Thus,  a  good  image  resolution  can  be  achieved  with  less 
aperture  size  and  sensors,  thus  decreasing  the  hardware  costs  of  an  ultrasound  system. 

In  summary,  the  PC -based  ultrasound  computing  architecture  of  this  report,  its  adaptive  2D  &  3D  ultrasound 
beamforming  structure  and  the  set  of  visualisation  tools  allow  for  a  flexible  cost-to-image  quality  adjustment. 
The  resulting  product  can  be  upgraded  on  a  continuous  base  at  very  low  cost  by  means  of  software 
improvements  and  by  means  of  hardware  by  taking  advantage  of  the  continuous  upgrades  and  CPU 
performance  improvements  of  the  PC -based  architectures.  Thus,  for  a  specific  image  resolution  performance, 
a  complete  re-design  or  product  upgrade  can  be  achieved  by  means  of  software  improvement,  since  the  digital 
hardware  configuration  would  remain  the  same. 
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